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[57] ABSTRACT 

An apparatus for transforming the resolution of an image 
from a first image resolution to a second image resolution 
using operations in the spatial frequency domain. A first 
group of transform values which represent the image at the 
first image resolution are mapped to a second group of 
transform values which represent the image at the second 
image resolution in the spatial frequency domain. The 
apparatus includes stored pre- computed values which are the 
mapping coefficient values between the first group of trans- 
form values and the second group of transform values. The 
pre-computed values are retrieved from a memory and used 
to directly map the first group of transform values to the 
second group of transform values in the spatial frequency 
domain. 
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METHOD AND APPARATUS FOR 
CHANGING RESOLUTION BY DIRECT DCT 
MAPPING 

FIELD OF THE INVENTION 

This invention relates to a processor fox changing the 
number of samples in a coded signal by directly mapping in 
the spatial frequency domain original transform coefficients 
in the coded signal to new transform coefficients, and more 
particularly, to changing the resolution of an encoded image, 
e.g., an image represented by MFEG-2 encoded video 
signals, by directly mapping original discrete cosine trans- 
form coefficients to new discrete cosine transform coeffi- 
cients. 

BACKGROUND OF THE INVENTION 

Id the United States a standard has been proposed for 
digitally encoded high definition television signals. A por- 
tion of this standard is essentially the same as the MPEG-2 
standard, proposed by the Moving Picture Experts Group 
(MPEG) of the International Organization for Standardiza- 
tion (ISO). The standard is described in a International 
Standard (IS) publication entitled, "Information 
Technology — Generic Coding of Moving Pictures and Asso- 
ciated Audio, Recommendation H.626", ISO/EEC 13818-2: 
1995 (E) which is available from the ISO and which is 
hereby incorporated by reference for its teaching on the 
MPEG-2 digital video coding standard. 

The MPEG-2 standard is actually several different stan- 
dards. In MPEG-2, several different profiles are defined, 
each corresponding to a different level of complexity of the 
encoded image. For each profile, different levels are defined, 
each level corresponding to a different image resolution. 
One of the MPEG-2 standards, known as Main Profile, Main 
Level (MP@ML) is intended for coding video signals con- 
forming to existing television standards (Le., NTSC and 
PAL). Another standard, known as Main Profile, High Level 
(MP@HL) is intended for coding high-definition television 
images. 

Images encoded according to the MP@HL standard may 
have as many as 1,152 active lines per image frame and 
1,920 pixels per line. Trie MP@ML standard, on the other 
hand, defines a maximum picture size of 720 pixels per line 
and 567 lines per frame. Hie high definition television 
standard proposed far HDTV encoding in the United States 
is a subset of the MP@HL standard, having as many as 
1,080 lines per frame, 1,920 pixels per line and a maximum 
frame rate, for this frame size, of 30 frames per second. 

The MPEG-2 standard defines a complex syntax which 
contains a mixture of data and control information. Some of 
mis control information is used to enable signals having 
several different formats to be covered by the standard. 
These formats define images, having differing numbers of 
picture elements (pixels) per Hue, differing numbers of lines 
per frame or field and differing numbers of frames or fields 
per second. In addition, the basic syntax of the MPEG-2 
Main Profile defines the compressed MPEG-2 bit stream 
representing a sequence of images in six layers, the sequence 
layer, the group of pictures layer, the picture layer, the slice 
layer, the macroblock layer, and the block layer. Each of 
these layers except the block layer is introduced with control 
information. Finally, other control information, also known 
as side information, (eg. frame type, macroblock pattern, 
image motion vectors, coefficient zig-zag patterns and 
dequantization information) are interspersed throughout the 
coded bit stream. 



7,019 

2 

An implementation of a HDTV system should be com- 
patible with existing systems such as NTSC and PAL. 
Accordingly, to effectively receive the digital images, an 
HDTV decoder should be able to generate a picture corre- 

5 spending to the MP@HL standard or the MP@ML standard 
to provide compatibility with existing receivers or transmit- 
ters. For example, the HDTV decoder should be able to 
generate a picture corresponding to the MP@HL standard 
from a MP@ML encoded signal or a picture corresponding 

1Q to the MP@ML standard from a MP@HL encoded signal. 
In addition, the use of new receivers having a high 
definition video monitor which can display an image gen- 
erated from a MP@HL signal may be cost prohibitive for 
certain customers. Accordingly, an HDTV decoder which 

15 can generate a picture corresponding to the MP@HL stan- 
dard or the MP@ML standard will allow the use of newer, 
lower cost receivers which have video monitors that provide 
a higher resolution than MP@ML but less than MP@HL. A 
television set containing one of these monitors should still 

20 be able to display an image generated from a MP@HL signal 
albeit at a lower resolution. 

Using existing techniques , a decoder may be implemented 
using an interpolation circuit to interpolate or decimate 
signals in the pixel domain to reduce the resolution of the 

25 image from MP@HL to the MP@ML. To process an 
MP@HL encoded image to produce an MP@ML signal by 
these conventional methods, the MP<£HL encoded image is 
converted from the spatial frequency domain to the pixel 
domain, interpolated to produce a reduced resolution image, 

30 and then the interpolated image is converted back to the 
spatial frequency domain. This type of processing would be 
contrary to the implementation of a decoder in a consumer 
television receiver in which cost is a major factor. Additional 
circuitry would be required to decode, interpolate or 

35 decimate, and then code the signal. Furthermore, the decod- 
ing and encoding operations may introduce undesired arti- 
facts into the image that is represented by the reduced- 
resolution coded signal. 
Another alternative is to use a decoder which selects a 

40 portion of the incoming HDTV bit stream, before decoding, 
as shown in SDTV RECEIVERS WITH HDTV DECODING 
CAPABILITY, by Jill Boyce et aL, dated Febuary 1995 and 
presented at the ACATS Technical Subgroup Meeting, May 
18, 1995. The decoder disclosed in the paper utilizes a 

45 number of techniques in an attempt to rednce the cost and 
complexity far a standard television receiver. A pre-parser 
examines the mcaming bit-stream and discards coding 
elements, DCT coefficients, of less importance. These ele- 
ments include the high frequency DCT coefficients. Hie 

50 coding elements are then converted from the spatial fre- 
quency domain to pixels in the pixel domain. The pixels are 
then down-sampled to produce pixels for a lower resolution 
image. 

There are other systems which have been proposed which 
55 utilize other transform techniques to encode an image. For 
example, Fourier Transforms and Zrtransforms have been 
used to encoded images in the spatial frequency domain. 
One such system is shown at page 183 of the Television 
Engineering Handbook by K. Blair Benson, dated 1992, 
60 which is incorporated herein by reference far its teachings 
on digitally encoding images. This system utilizes Fourier 
Transforms to encode the image. As in the MPEG standard, 
this system could be used to encode images at different 
resolutions. Thus, the need far the conversion between 
65 higher and lower resolution images to provided compatibil- 
ity between different receivers is also, required for these 
systems. 
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SUMMARY OF THE INVENTION frequency domain. As a result, the original OCT coefficient 

. . values F f ,(u'y) do not have to be converted to pixels in the 

The present invention is embodied in an apparatus far p^gj domain to increase or decrease the resolution of the 
transforming the resolution of an image from a first image image by, for example, decimation or interpolation in the 
resolution to a second image resolution using operations in 5 domain. Thus, the need for additional circuitry to 

the spatial frequency domain. A first group of transform convert the coefficients to pixels to Hftrj in*rte or interpolate 
values which represent the image at the first image resolu- the pixels and to correct the decimated or interpolated pixels 
tion are mapped to a second group of transform values which back to DCT coefficient values is eJiminated. 
represent the image at the second image resolution in the Overview 
spatial frequency domain. The apparatus includes stored 1Q . 
pre-computed values which are the mapping coefficient The conversion of the original DCT coefficient values 
values between the first group of transform values and the fqWrt to *c converted DCT coefficient values F, i (u,v) 
second group of transform values. The pre-computed values m mc transform domain is feasible because there are cor- 
are retrieved from a memory and used to directly map the relations of the spatial pixels in the picture before and after 
first group of transform values to the second group of 5 me conversion which translates to a correlation between the 
transform values in the spatial frequency domain. DCT coefficient values at different resolutions. Transform 

values in the spatial frequency domain for other transform 
BRIEF DESCRIPTION OF THE DRAWINGS methods including, for example, Fourier Transforms and 

Z- transforms, can also be converted to converted transform 

FIG. 1 is a block diagram of a DCT conversion apparatus vames because there are correlations of values in the time 
in accordance with an exemplary embodiment of the present 20 domain before and after the conversion which translates to 
invention. a correlation between the transform values at different 

FIGS. 2(a) and 2(b) are flow chart diagrams illustrating resolutions, 
the operation of the DCT converter 140 shown in FIG. 1 in The original DCT coefficients values F e /u\v') define an 
accordance with an exemplary embodiment of the present image having a first resolution and are produced by con- 
invention. 25 verting the pixels in the image to DCT coefficient values 

FIG. 3 (a) is a data structure diagram illustrating six using an N point two-dimensional DCT. The N point two- 
macroblocks. dimensional DCT is defined in equation (1): 

FIG. 3(&) is a data structure diagram illustrating the 
contents of one of the macroblocks shown in FIG. 3(a). 30 'V 1 ^ = 0) 

FIG. 3(c) is a data structure diagram illustrating a con- 2 fc-i 

verted macroblock CMB generated from the six macrob- 77" " ^"^^ £o£a f <yfo»0«» - 

locks shown in FIG. 3(a). 

FIG. 4 is a data structure diagram illustrating the mapping F e Ju'y) is the original DCT coefficient value for the f-rh 
of six macroblocks to one macroblock in the pixel domain. 35 Wock ^ &e ^ jnacroblcck where u' and V are coordi- 

HGS. 5(a) and 5(b) are charts illustrating the format of nates in the spatial frequency domain and u\v*=0, 1, 2, . . . 
the MPEG scan pattern 0 and the MPEG scan pattern 1. N-l; f f /m,n) is a pixel value in the image where m and n 

FIG. 5(c) is a chart fllusrraring the format of the DCT are spatial coordinates in the pixel domain and m^n=0 . . . , 
coefficients after inverse zig-zag scan by inverse zig-zag N-l; and c(u*) and c(v*) are the transformation coefficient 
scan memory 120 shown in FIG. 6. 40 values defined in equation (2): 



FIG. 6 is a block diagram of a decoder apparatus in 



accordance with an exemplary embodiment of the present f (j/MT) for 



c(t)=i w*J i«r i = 0 

I 1 otherwise 



(2) 



invention. 

FIG. 7 is a block diagram of another exemplary embodi- 45 

ment of the present invention directed to an MFEG-2 bit Conversely, a pixel value f jyimji) of the image can be 

stream down conversion circuit produced from the anginal DCT coefficient values F^u*, vO 

FIG. 8 is a flow chart illustrating the operation of the * Ftt^^/T^ c ^^ fonn (SDC] ^' 

im7P 0 . .. ^ j . s . . The N point TDCT is defined by equation (3): 
MFEG-2 bit stream down conversion circuit shown in FIG. 

^' 30 fyfa*) = (3) 

FIGS. 9(a) and 9(b) are data structure diagrams illustrat- 
ing the operation of steps 700, 800, 810, and 820 shown in .2. j^z 1 ^u'Uiy^i 1 ^ f2m '^ Vw coj ^ffi* 



FIG. 10 is a data structure diagram illustrating the orga- 



nization of macrohlocks in a slice. 55 The resolution of the image can be increased or decreased 
FIGS. 11(a) and H(b) are data structure diagrams which °y» for example, interpolation or decimation of the pixel 
illustrate the lurninance macroblock structure in frame DCT values f f j(mji) in the pixel domain, For example, a con- 
coding and the luminance macroblock structure in field DCT verted pixel value f^x^y) can be produced from the original 
coding far a 4:2:0 block format ^ pixel values f f /mji) using a linear superposition of pixels 

of the original image in the pixel domain as shown in 

DETAILED DESCRIPTION OF THE equation (4): 
EXEMPLARY EMBODIMENTS 

m , , , ^ . N-l N-l tl (4) 

The exemplary embodiment of the present invention Ata0 8 £ £2 I ftji^) 

changes the resolution of an image to a different resolution 65 0=0 

by mapping DCT coefficient values F f/ (if ,v*) of the original a is the conversion coefficient between the original pixel 

image into converted coefficient values F^u,v) in the spatial values f rj (mp) and the converted pixel values f^x,y). The 
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image defined by the converted pixel values f#(x»y) has a 
different resolution than the image defined by the original 
pixel values f r/ (nun). 

Converted DCT coefficient values (u,v) can be pro- 
duced from the converted pixel values f y (x,y) using equa- 
tion (5): 



(5) 



2 

7* 



N-l N-l 



10 



F^(u,v) is the converted DCT coefficient value for the j-th 
block and the i-th macroblock where u and v are coordinates 
in the spatial frequency domain in the converted image and 
u,v=0 . . . , N-l and f/,<x,y) is the converted, pixel value 
where x and y are spatial coordinates in the pixel domain of 
the converted image and x,y=0 . . . } N-l. The correlation 
between the original pixel values f f/ (itun) and the converted 



15 



coordinates in the spatial frequency domain of the converted 
DCT coefficient values F^v) and u,v=0, 1, 2, ... N-l; and 
a is the conversion coefficient 

Exemplary values fox the conversion coefficient a are 
shown in Tables 1-6 below for converting six macroblocks, 
arranged as three by two macroblocks, into one macroblock 
and as described below. Since each value, x, y, m, n, u, v t u\ 
v\ and a in equation (9) is a known constant, the pre- 
computed values PCV can be calculated using equation (9) 
independent of the original DCT coefficients values F f/ (u\ 
v*) to be converted. The calculation of the pre-computcd 
value PCV does not depended upon the original DCT 
coefficient values Fj^tfy) or the converted DCT coefficient 
values F^UjV). The pro-computed values PCV are used to 
convert any original DCT coefficient values F^u'y) to 
converted coefficient values F^<u,v) for a conversion of six 
macroblocks, arranged as three by two macroblocks, into 
one converted macroblock. 

As described above, the converted DCT coefficient values 



DCT coefficient values Fg(u,v) is demonstrated below in 20 F^u f v) correspond to an image having a different resolution 
equation (6) in which equation (5) is rewritten by substitut- than the image represented by the original DCT coefficient 
ing the right hand side of equation (4) for the converted pixel values F f/ (u\v'). Therefore, the resolution of an image can 
values f(/(x,y). be changed by mapping the original DCT coefficient values 



N-l N-l , 



N-l N-l \ 



■ cos Prffi* 



(6) 



Since the original pixel values ffXnvi) can be expressed in 
terms of the original DCT coefficient values F^u'y) as 
shown in equation (3), the converted DCT coefficient values 
Fy{u^v) can be expressed in terms of the original DCT 
coefficient values F jy (u , ,v t ). This is demonstrated in equa- 
tion (7) below in which the right hand side of equation (3) 
is substituted for the original pixel value F r/ (m,n) shown in 
equation (6). 



F r/ (u\vO to the converted DCT coefficient values F^(u,v). 
30 This eliminates the need for additional circuitry to convert 
the original DCT coefficient values F f /u\v*) to pixels 
values to perform interpolation or declination and the cir- 
cuitry required to convert the pixels back to converted DCT 
coefficient values Fy(u,v) to complete processing. In 
addition, the processing time to convert the image is 
decreased by eliminating the steps of converting the DCT 



N-l N-l N-l N-l N-l N-l 
££ X X £ £ £ Z 



Equation (7) can be rewritten as equations (8) and (9): 



'^IJAA ' ****** 



(8) 



50 



where: 



(9> 



55 



COS 



^1: 



60 



m and n are spatial coordinates of the original pixel values 
f f/ (m,n) in the pixel domain and mjot=0, . . . , v, x and y are 
spatial coordinates of converted pixel values f & <x,y) in the 
pixel domain andx,y=0 . . . N-l, u' and v* are coordinates in 
the spatial frequency domain of the original DCT coefficient 
values r e /ja\V) and u'y=C t 1, 2, . . . N-l; u and v arc 



65 



coefficients to pixel values, processing the pixel values and 
then converting the processed pixel values back to DCT 
coefficients. Finally, the converted image produced by this 
method has fewer artifacts than an image mat has been 
converted into the pixel domain, interpolated, and then 
converted back into the spatial frequency domain. 

DESCRIPTION OF EXEMPLARY 
EMBODIMENTS 

FIG. 1 illustrates the overall organization of a DCT 
conversion apparatus 5 which maps original DCT coefficient 
values F (u\vO to converted DCT coefficient values F^(u,v) 
in the spatial frequency domain in accordance with an 
exemplary embodiment of the present invention. The DCT 
conversion apparatus 5 either reduces or increases the num- 
ber of original DCT coefficient values F^u'y). 

As shown in HG. 1, encoded image data represented by 
original DCT coefficient values F f/ (u , ,v') are stored in 
memory 10. The encoded image data is, for example, a 
MP@HL or MP@ML encoded image. The original DCT 
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coefficient values F r /u\V) are arranged in macroblocks and the converted pixel values f^<u»v) are located at each of the 

are not quantize. The original DCT coefficient values F f/ indices 310 having a filled circle. In FIG. 4, the original 

(u',v') are provided to DCT converter 140 which maps the image is 1920 by 1080 pixels and the converted image is 640 

original DCT coefficients F f /u % y) into converted coeffi- by 540 pixels. The original image is effectively horizontally 

cient values F^v) which represent a reduced-resolution 5 decimated by three and effectively vertically deci m a t ed by 

image or an increased resolution image. For example, when two to produce an image having a 640 by 540 pixel 

the input bit-stream is converted from MP@HL to resolution. The effective decimation factors for horizontal 

MP@ML, the number of DCT coefficients is reduced. When and vertical directions are determined in response to the 

the input bit- stream is converted from MP@ML to control signal CS2. There is a corresponding set of pre- 

MP@HL, the number of DCT coefficients is increased The to computed values PCV stored in memory 40 far each set of 

converted DCT coefficients are stored in memory 30. DCT horizontal and vertical decimation factors a^^^^. As 

converter 140 is described in greater detail below. described above, the pre-computed values PCV are calcu- 

DCT converter 140 maps the original DCT coefficient lated using equation (9) and stored at respective memory 

values F iy (u',v') to the converted coefficient values Fy(u,v) locations in memory 40 shown in FIG. 1. 

in response to a control signal CS2 which specifies the 13 Next, at step 210 as shown in FIG. 2{a\ the pre-camputed 

change in resolution of the image i.e. — converting a 1920 by values PCV are retrieved from memory 40 and provided to 

1080 interlaced image to a 640 by 540 interlaced image. la DCT converter 140. The pxe-computed values PCV are 

response to the control signal CS2, original DCT coefficient selected from memory 40 in response to the macroblock, 

values f P/ , (v*, V) are retrieved from memory 10 and block, and the address value of the original DCT coefficient 

pre-computcd values PCV stored in memory 40 are retrieved 20 va j ues am j ^ e converted DCT coefficient values. The pre- 

in response to select signal SSI. Memory 40 is, for example, computed values PCV are stored at an address in memory 40 

a random access memory or a read only memory. specified by address signal SSI. Address signal SSI pro- 

The pre-computed values PCV, as described above, can be vides the address of the pre-computcd value PCV for con- 
calculated independent of the original DCT coefficient val- verting the zl-th DCT coefficient value of the j*-th block of 
ues F,y(u'y). The pre-computed values PCV are stored in 25 the i'-th original macroblock to the z-th DCT coefficient 
memory 40 prior to converting the original DCT coefficient value of the j-th block of the converted macroblock. zl is the 
values Fpjiu'y) to converted DCT coefficient values F^<u, address value of the original DCT coefficient value and z is 
v). The pre-computed values PCV are retrieved from the address value of the converted DCT coefficient value, 
memory 40 as described below. As shown in equation (8) Nexti at step 220, the converted coefficient values F^v) 
and described in greater detail below, the original DCT M m ^g me original D CT coefficient values 
coefficient values F r /p\V) are multiplied by corresponding p , tf ^ ^ ^ ^0^^ vahlcs pcv in accordance 
pre-computed values PCV and summed to produce con- ^ equation (8). Table 0 below is exemplary C code for 
verted pre-computed values F 0 <u,v) in the spatial frequency determining the converted coefficient values F fr {u,v) using 
domam - - 5 the original DCT coefficient values F f /u\v') and pre- 

The DCT converter 140 is explained below in greater computed values PCV. In Table 1, the values are defined as: 

detail with reference to FIGS. 2-4. First, at step 200 shown y designates the j-th block of the converted macroblock; 

in FIG. 2(a), the DCT converter 140 is set in response to z designates the z-th DCT coefficient value of the j-th block 

control signal CS2 to convert the original DCT coefficient of me converted macroblock; 

values Ff/uW) in the spatial frequency domain. Control ^ n . designates ^ macroblock of the original macrob- 

signal CS2 specifies the change in resolution of the image to locks* 

be converted. j 1: designates the j'-th block of the i'-th original macroblock; 

The original DCT coefficient values F.yCu'y) are con- z l: designates the zl-th DCT coefficient value of the J-th 

tained in macroblocks. FIG. 3(a) is a data structure diagram block of the i'-th original macroblock; 

illustrating six macroblocks MB0-MB5 which constitute a 4J map [j] [ z ] [il] 01] [zl]: designates the pre-computed value 

portion of an image to be converted. PCV for converting between (1) the z-th DCT coefficient 

As shown in FIG. 3(b\ each macroblock MBO-MB5 value of the j-th block of the converted macroblock and 

comprises six blocks: four luminance blocks WM>3 and two (2) the zl-th DCT coefficient value of the j'-th block of the 

chrominance blocks M and b5. This format is identified as i'-th original macroblock; 

4:2:0 in the MPEG-2 standard. so mb__old: designates the original macroblocks MB0-MB5; 

As shown in FIG. 5(c), each block of the blocks b(M>5 mb_new: designates the converted macroblock; and 

contain sixty four DCT coefficients assigned an address declipQ: designates dipping the DCT coefficients in the 

value zl of zero to sixty three. Alternatively, the address range of [-2048, 2048]. 
value could be specified by the spatial coordinates u\ v* of 

the original DCT coefficient values F^tfy). Each of the 55 TABLE 1 

converted DCT coefficient values F^u t v) also contains sixty ^^ ving(mb _ 0 ^ mKjlcv) 

four DCT coefficients, each assigned an address value z of »hartmbIold[6] 16] [64}, /• 6 input MB's •/ 

zero to sixty three. The original DCT coefficient values axe sboitmh_newt6] [64]; /♦ 1 New output MB ♦/ 

retrieved from memory 10 by specifying the address value { 

zl of the original DCT coefficient value, the j'-th block which 60 *^-f£** an; 

includes the original DCT coefficient value, and the i'-th imxly; 

macroblock which includes the J-th block. /* % hxmmanoo */ 

The conversion of the macroblocks in FIG. 3(a) is shown to CH^M; { ^i?FI h ^!Z^ 

in FIG. 4, where the image is represented by pixels in the 2<64; 

pixel domain and arranged into macroblocks MB0-MB8 65 each bbek */ 

where the macroblocks are in frame format Original pixel eam= 0 
values F f/ (m,n) are located at each of the indices 300 and 
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TABLE 1 -continued 



for fil=0; il<6; U++) { /* 6 input MB*a f 

far 01=0; jl<4; jl++) { f* 4 DCT blocks */ 

far (zl=0; zl<64; zl++) { /*8by8DCT 
coefficients */ 

mm 4= 

(mapQl [>] fl] DOM 
tnb_oJdIQ] 01] [dD; 

} 

} 

mb _jJew{j] [2] = delijtfsum); 

} 

} 

/* Ch r m ri fo 0 "*^ Cr and 
Cb */ 

for 0=4; >06; j-H-) { A* one block far each 

CrandCb •/ 

for (z=0, z<64; z++) { /* 8 by 8 output DCT 

1 1 in ffff i^-pf for yfffh 
block*/ 

sum = 0; 

for (11=0; iktf; { /* 6 input MB's */ 

for (zl=0; xl<*34; zl-H-) { /• 8 by 8 input 

DCT coefficient far 
each block ♦/ 
sum 4= (mapC[z) [UJ [xl)»mb_j[>ld[il] [jl 

} 

} 

mb_jiewG] [z] = dclip(sum); 

} 

} 

} 



Steps 210 and 220 and the code in Table 1 are explained 
with reference to the flow chart shown in FIG. 2(b). First, at 
step 410, it is determined which converted DCT coefficient 
value Fj(u,v) is to be produced. Far a conversion from six 
macroblocis to one macroblock, sixty four converted DCT 
coefficient values are produced. The converted DCT coef- 
ficient values are produced consecutively starting with the 
converted DCT coefficient value assigned an address value 
of zero to the last converted DCT coefficient value assigned 
an address value of sixty three. Then, at step 415, the value 
F-temp is set equal to zero. . 

Next, at step 420, an original DCT coefficient value 
FfMy) is retrieved from memory 10 shown in FIG. 1. 
DCT converter 140, shown in FIG. 1, maintains an address 
for each of the original DCT coefficient values Ff/u'y) 
stored in memory 40. Hie address is specified by the address 
value zl, the block value jl, and the macroblock value il for 
the original DCT coefficient values F f/ (u',v*). The address 
value zl identifies one of the original DCT coefficient values 
F f/ (u'y), the value jl specifies from which block the 
original DCT coefficient values F^u^V) are retrieved, and 
the value il specifies from which macroblock the original 
DCT coefficient values F^u'^') **e retrieved. The 
addresses for retrieving the original DCT coefficient values 
F e /u\V) from memory 40 are produced by DCT converter 
140. 

DCT converter 140 determines which original DCT coef- 
ficient values F r /u\V) are retrieved in accordance with the 
original DCT coefficient values F f /u',V) specified in equa- 
tion (8) and used to calculate the next converted DCT 
coefficient value F^(d,v) determined at step 410. 

Far example, as shown in the code above in Table 1, the 
luminance macroblock for the converted macroblock is 
produced from each of the DCT coefficient values F f/ (u',vO 
in each of the original six macroblocks. The original DCT 
coefficients F r y(u > ,v r ) are consecutively retrieved from the 
first block in the first original macroblock. That is, each time 
step 420 is repeated, the next consecutive original DCT 



t7,019 

10 

coefficient value is retrieved. Once all of the original DCT 
coefficients F^^v 1 ) arc retrieved from the first block, (he 
original DCT coefficient values F^u'jV') in the next block 
in the first macroblock are retrieved. Once all of the original 

5 DCT coefficients F f/ (u'y) in the first macroblock have been 
retrieved, original DCT coefficient values are retrieved from 
the first block of the next macroblock. This process is 
repeated until all of the original DCT coefficient values 
F,y(u',v*) in each of the macroblocks have been retrieved. 

10 Next, at step 440, DCT converter selects pre-computed 
values PCV from memory 40. As shown in the code of Table 
1, the values z, j, zl, jl, and il are also used to determine 
which pre-computed values are retrieved from memory 40. 

^ As described above, there is a pre-computed value PCV 
stored in memory for mapping between the z-th converted 
DCT coefficient of the j-th block of the converted macrob- 
lock and the zl-th original DCT coefficient of the jl-th block 
of the il-th macroblock. 

20 The pre-computed values are calculated using the values 
a shown in Tables 1-6 below as described above and shown 
in equation (9). 

Table 2 includes the values a used to convert luroinance 
block b0, Table 3 includes the values a used to convert 

25 luminance block bl, Table 4 includes the values a used to 
convert luminance block b2, Table 5 includes the values a 
used to convert luminance block b3, Table 6 includes the 
values a used to convert chrominance block b4, and Table 
7 includes the values a used to convert chrominance block 

30 b5. Hie pre-computed values PCV arc generated from the 
values a in Tables 1-6. 



TABLE 2 


35 


affray 1 


fari<3, y < 4 and even 






fcrx<3, y<4and odd 


40 




forx<3, y<4and odd 






for 3 < = x < 6, and y < 4 and even . 


45 




far 3 < = x < 6, and y < 4 and odd 




*jjQjt» 1 


far 3 < ~ x < 6, and y < 4 and odd 






far x > = 6, and y < 4 and even 


50 










for x > = 6, ood y < 4 and odd 






for x >=6, and y < 4 and odd 


55 




foix<3, y> = 4aad even 






ferx<3,y> = 4andodd 


60 




farx<3,y> = 4andodd 






far 3 < = x < 6, andy > = 4 and even 


65 


qSfi?a>fUoMH = T 


for3< = x<6,tndy> = 4 ml odd 



03/18/2004, EAST Version: 1.4.1 



11 



5,737,019 



12 



TABLE 2-continued 



TABLE 4-continued 





for 3 < = x < 6, and y > = 4 and odd 




for x > = 6, and y > = 4 and oven 




fori>=6, andy> = 4 and odd 




for k > = 6, and y > = 4 and odd 


TABLE 3 




far x < 3, and y > = 4 and even 




for x > 3, and y > =4 and odd 




forx>3, andy> = 4 and odd 




for 3 <=x< 6\andy >- 4 and even 


os3j^^hi^-i =-5- 


for3<=x<6,andy> = 4andodd 




for 3 < = x < 6, and y > = 4 and odd 




for x > « 6, and y > = 4 and even 




far x > = 6, and y > = 4 and odd 




for x > = 6, and y > = 4 and odd 




far x < 3 and y >= 4 and even 




fcrx>3, andy> = 4andodd 




for x > 3, and y > = 4 and odd 


cfife-3>tu<r-*) = 1 


for 3 < = x < 6 and y >~ 4 and even 




fbr3< = x<6, aDdy> = 4ond odd 




Jar 3 < = x < 6, and y > = 4 and odd 




far x > = 6, and y > = 4 and even 




for x > = 6 and y > = 4 and odd 




for x >= 6, and y > = 4 and odd 


TABLE 4 




fat x < 3, y < 4 and even 




for x < 3, y < 4 and odd 




for x< 3,y<4 aad odd 



10 



15 



20 



30 



35 



45 



50 



55 



60 



65 







for 3 <s= x< 6, and y < 4 and even 






for3<e=x<6, andy<4andodd 






fox3<?x<6, andy<4aod odd 






far x >= 6, and y < 4 and even 






fox x >= 6\ and y < 4 and odd 






far x >= 6, and y <4 and odd 










far x < 3, y >« 4 and even 






for x < 3, y >=■ 4 and odd 






farx<3,y>=4andodd 






for 3 <= x < 6, and y >= 4 and even 






for3<=x<6,andy>=4andodd 










for 3 x < 6, and y>=4 and odd 










for x >= 6 t and y >= 4 and even 






for x >= 6, and y >= 4 and odd 






fori>=6, and y >= A and odd 


TABLE 5 




for 


x < 3, y < 4 and even 




for 


x < 3, y < 4 and odd 


a8&*i =4" 


for 


x<3, y<4andodd 




for 


3 < = x< 6, and y < 4 and even 




for 


3 < 0 x < 6, and y < 4 and odd 




for 


3 < = x < fi, and y<4 and odd 










for 


x >- 6, andy < 4 and even 




far 


x > = 6, andy < 4 and odd 




for 


x > = 6, and y < 4 and odd 




for 


x < 3, y > = 4 and even 




for 


x < 3, y > = 4 andocH 
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TABLE 5-continued 



«3 „ 1 farx<3,y> = 4and odd 

<3!kj£Vuo~Q = 1 fbr3< = x<6,andy> = 4and even 



aj „ 1 f or 3 < = x < 6, and y > = 4 and odd 

<S2j£-S>tUCr4>-l = T 



A3 « 1 for3< = *<6 t tndy> = 4and odd 

<^*£«>fUtr-0 = 1 forx> = 6\andy > = 4and*ven 

_ 1 for x > = 6, and y > = 4 and odd 



w „ 1 fcr x > = 6, and y > = 4 and odd 



TABLE 6 

far x < 3, y <4 and even 

far x<3, y<4andodd 

far x < 3, y < 4 and odd 

fbr3< = x<6 t y<4 and even 

for3< = x<6,y<4 and odd 

Car3< = x<6 f y<4andodd 

for x > = 6, and y < 4 and even 

for x > = 6, and y < 4 and odd 

for x > = 6, and y < 4 and odd 

farx<3, y> = 4 and even 

farx<3, y> = 4and odd 

firxO, y > = 4 and odd 

far 3 < = x < 6, and y > = 4 and even 

far3< = x<6,andy> = 4andodd 

far 3 < = x < 6, and y > = 4 and odd 

far x > = 6, and y > = 4 and even 

far x > = 6j and y > = 4 and odd 

far i > = 6, andy> = 4andodd 



10 



15 



20 



25 



30 



35 



40 



TABLE 7 




forx <3, 


, y < 4 and even 


1 


for x < 3j 


p y ^ 4 and fyf*i 




farx <3, 


, y <4 and odd 




far 3 < = 


x < 6, and y < 4 and even 




for 3 < = 


x < 6, and y < 4 and odd 




for3 < = 


A U| MUU Jf HULA vVU 






6, and y < 4 and even 




forx > = 


6, andy < 4 and odd 




mr x > — 


o, ana y < 4 ana ooa 




forx < 3, 


, and y > = 4 and even 




forx <3, 


,y> = 4 and odd 




ft*, w 1 

uXT X C J, 


, y > — 4 and odd 




far3 < = 


x < 6, and y > = 4 and even 




for 3 < = 


x < 6, andy > = 4 and odd 




for 3 < = 


x < 6, and y > = 4 and odd 




forx > = 


6, and y > = 4 and even 




forx> = 


6, and y > = 4 and odd 




forx> = 


6, and y > = 4 and odd 



45 



50 



55 



60 



65 



The pre-campuicd values PCV calculated from the values 
a in Tables 2 to 7 arc for a frame to frame DCT conversion 
of the DCT coefficient values. FIGS. 11(a) and ll(fc) illus- 
trate the luminance macrohlock structure in frame DCT 
coding and the luminance macroblock structure in field DCT 
coding, respectively, for a 4:2:0 block format In a frame 
coded macroblock, each block, b0-b3, is composed of two 
fields alternatively. In a field coded macroblock, each block, 
b0-b3, is composed of lines from one. of two fields. The 
chrominance macroblocks for each format are organized in 
frame format The pre- computed values are for converting a 
set of frame coded macroblocks to a single frame coded 
macroblock. Pre- computed values could also be provided 
for converting a set of field coded macroblocks to a single 
field coded macroblock. It is advantageous to provide pro- 
computed values for one type, frame to frame or field to 
field, conversion to reduce (he size of the memory used to 
store the coefficients. 

Alternatively, the pre-computed values PCV can be cal- 
culated from the values a by OCT converter 140. Table 8 
below is pseudo code for calculating the prccomputcd values 
from the values a. 
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TABLE 8 



if x < = N-l then 

y = 0 

if y < = N-l then 
m = 0 

if m < = N-l then 
n = 0 

ifu< = N-l then 

TMP = cx(i]0]lmnn]TMP = ariOTml[Q)-cos-^^^- cos ^"ffi"* • 

ccs (2m ^ .cos ^y 

PCV^PCV + TMP 
n = d+1 
goto 40 
else m = m + 1; goto 30 
else y = y + 1; goto 20 
else z = x+ 1 
else cod 



In this alternative embodiment, the values a are stored in 
memory 40. Hie values a are retrieved from memory 40 and 
the pre-camputed values PCV are calculated by converter 
140 using the pseudo code in Table 8. 

Next, at step 460, a temporary value ftemp is calculated 
by adding the previous temporary value Ftemp to the 
retrieved original DGT coefficient value multiplied by the 
pre-computed value PCV. Since converted coefficient values 
Fy(u,v) can be generated from a number of original coeffi- 
cient values F(y(tf ,v*)i it is next determined, at step 470, if 
any more original coefficient values F^u'yV*) are required to 
produce the selected converted coefficient value F»(u,v). If 
additional original coefficient values F^u'y) are required, 
step 420 is repeated. Otherwise, at step 480, the converted 
coefficient value Fy(u,v) is set equal to the value Ftemp. 
Then, at step 490, it is determined if any more converted 
coefficient values F,/u,v) of the converted macroblock are to 
be produced. If more converted coefficient values F^<u,v) are 
to be produced, then, step 410 is repeated. 

As a result, converted DOT coefficient values F^(u,v) can 
be generated from original DCT coefficient values F f/ (u',Y r ) 
in the spatial frequency domain rapidly and without con- 
verting the DCT coefficient values to pixels values. 

Although the above exemplary embodiment of the present 
invention discusses the use of direct DCT mapping to 
effectively decimate or interpolate an MPEG coded signal, 
direct mapping of coefficient values can be applied to any 
system which requires the decimation or interpolation of a 
signal in the pixel domain by directly mapping the signal 
represented by transform coefficients in the spatial fre- 
quency domain. 

FIG. 6 illustrates the overall organization of a decoder 
including the DCT converter 140 which maps original DCT 
coefficient values F fJ {u\V) to converted DCT coefficient 
values Fy(u,v) in accordance with another exemplary 
embodiment of the present invention. As shown in FIG. 6, 
an input bit-stream IBS is applied to variable length decoder 
(VLD) 100. The input bit-stream is, for example, a MP@HL 
encoded bit-stream. VLD 100 decodes the input bit stream 
IBS to generate blocks of quantized discrete cosine trans- 
form (DCT) coefficient values QDCT. The quantized DCT 
coefficient values QDCT are provided to inverse zig-zag 
scan memory 110 which reorders the coefficient values. 

The DCT coefficient values in the macroblocks are pro- 
vided one value at a time in formats specified by the above 
referenced MPEG-2 specification. FIGS. 5(a) and 5(b) illus- 



trate the two different zig-zag scan patterns: pattern 0 and 
pattern 1, used in the MPEG-2 specification. In the inverse 

25 zig-zag scan memory HO, the type of scan pattern is 
detected and the DCT coefficient values are rearranged as 
shown in FIG. 5(c). 

Next, the DCT coefficient values are provided to filter 
120. Filter 120 is a low pass filter which diagonally truncates 

30 the macroblocks to eliminate the high frequency compo- 
nents of the image when the image resolution is to be 
reduced. Controller 160 provides a control signal CS1 to 
enable or disable filter 120. Filter 120 is used to prevent 
aliasing. Filter 120 does not filter the macroblocks when a 
higher resolution image is produced from a lower resolution 

33 image. 

The DCT coefficient values are then dequantized in 
inverse quantizer 130. The dequantized coefficient values, 
which are the original DCT coefficient values F.yCu'y), are 
stored in memory 10. Memory 10, DCT converter 140, and 

40 memories 30 and 40 operate as described above in the first 
exemplary embodiment Controller 160 provides control 
signal CS2 to DCT converter 140. Control signal CS2 is the 
same as the control signal CS2 described above in the first 
exemplary embodiment 

45 FIG. 7 is another exemplary embodiment of the present 
invention directed to MPEG-2 bit stream down conversion 
circuitry. In this embodiment, in addition to changing the 
resolution of the image by DCT mapping, new header 
information and motion vectors are produced for resulting 

20 images. In the exemplary embodiment shown in FIG. 7, the 
original motion vectors are scaled and a suitable motion 
vector is generated from the macroblocks in the original 
image to produce motion vectors for the new macroblocks in 
the different resolution image. 
The basic syntax of the MPEG-2 Main Profile defines the 

55 compressed MPEG-2 bit stream as a sequence of images in 
five layers, the sequence layer, the group pictures layer, the 
picture layer, the slice layer, and the macroblock layer. Each 
of these layers is introduced with control information: the 
sequence header, SH, far the sequence layer, the group of 

60 pictures header, GOPH, for the group of pictures layer, the 
picture header, PH, for the picture layer, the slice header, 
SLH, for the slice layer, and the macroblock layer header, 
MBH, for the macroblock layer. Finally, other control 
information, also known as side information, (e.g. frame 

65 type, macroblock pattern, image motion vectors, coefficient 
zig-zag patterns and deqiiantization information) are inter- 
spersed throughout the coded bit stream. 
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As shown in FIG. 7, an input hit-stream IBS containing 
the layers and control information is applied to variable 
length decoder (VLD) 605. The input bit-stream is, far 
example, a MP@HL encoded bit-stream. VLD 605 decodes 
the input bit stream IBS to generate blocks of quantized 
discrete cosine transform (DCT) coefficient values. In 
addition, VLD 606 reorders the quantized coefficients values 
by performing an inverse zig-zag scan. The quantized DCT 
coefficient values QDCT are provided to filter 120. VLD 605 
also provides the sequence header SH to a first converter 
610, the group of pictures header GOPH to a combiner 670, 
the picture header PH to the second converter 620, the slice 
header SLH to third converter 630, and the macroblock layer 
header MBH to the fourth converter 640. 

The first, second, and third converters 610, 620, and 630 
make minor, mostly fixed value changes to the sequence 
header SH, the group of pictures header GOPH, the picture 
header PH, and the slice header SLH, respectively, is 
response to the change of resolution. Table 9 below provides 
exemplary pseudo code for changing the header information 
as a result of the conversion. 

TABLE 9 

slke0{ 

/* slice header processing here : no 
change */ 
slioe_start_code 
if (vcrtkaL_aize > 2800) 

if ( rf*ff*^ yt^T K*e re alafriV ^e gtwriMnH Q IS 

present in the bit stream>) { 
if (scahblc__m«Je — "data party-mi ng") 
priority breakpoint 



} 

quantizeT_£cale_jcodc 
if (nexftitsO = 4 V){ 
inlr 3_fi Kcft .flag 

intra slice 

ieservecL_btts 

while <martbiis0~*r){ 

extra_bit_slice /*wfth the value 0*/ 

errt n fnfrrrmatin n slice 

} 

} 

extra_bxt slice /* with the value 1 */ 
sliccLJUodulo = filic$_£» % M; 
if (slice_jnoduk> f= M-l) { 
do { 
macrobkckO; 

nrvene_DCT0: 

f ave_3ffi__iiirbniiatjoiu_s lice (s lice__modiila, 
xnb); 

} while ( nextbta != "000 0000 0000 0000 
0000 0000 00007; 

} 

ebe {/*l2st of M slices*/ 
*>< 

macrobbckO; 
inverae_quantizie(); 
invene < _dct0; 
xnb—znodolo b mb % N; 
gvc_MB.. jnrnmrarinn _ MBQnb_iaodulo); 
if (mb __n»dulo = N-l) { 
encode_joutpul Q» 

} 



•ooooooooooooooo 

0000 0000' 



} while ( oextbitt != 
1 

> 

/*whete, mb — macroblock 
number ootiuliii£ fa un start 
of dke// 

e re, MTR i nfi ■ 1 1 ut I m * i cKr^fo Kr*; mrvfalr^ mb) { 
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TABLE 9-continiicd 



save macroblock mfonnataons at sliccLjyvtiTio 
and mb. 

Tnere are (M-l) slices of macroofcek 



> 



where, 



10 



■ {macroblock 



macrob kxfr modca 

type, 

frBIOCi/filG XQOtlQQ 

type, dct_type}, 

tnntifm , vw!tnwi ) 

coded block partem, 
DCT coefficients 

}•/ 

save macroblock inmrmanbn at *r>v> mrvhiln 
Tbere are N Macroblock information. 

} 



The sequence header SH, the group of pictures header 
GOPH, the picture header PH, and the slice header SLH are 
modified in response to the size conversion factor specified 

25 for the image represented by the input bit stream IBS. The 
format of these headers are specified in the above referenced 
MFEG-2 standard at sections 6.2 and 63. Converters 
610-640 modify the headers SH, GOPH, PH, and SLH in 
response to header control signal HCS which specifies the 

30 change from the input image resolution to the output image 
resolution. 

The motion vectors provided with the macroblocks in the 
original image generally require modification after decima- 
tion or interpolation of the macroblocks since a large amount 

35 of processing is performed to produce the image with a 
different resolution. Whether a macroblock has a motion 
vector depends upon whether the macroblock is intra coded 
or non-intra coded. A macroblock is intra coded (I-coded) if 
it is coded using only information from a single frame. A 

40 macroblock is non-intra coded if it is coded using motion 
compensated prediction from past reference fields or frames 
(P-coded) or coded using motion compensated prediction 
from past and/or future reference fields or frames (B -coded). 
As described above with reference to FIG. 1, the original 

45 DCT coefficient values F r/ (u\v') are dequantized by inverse 
quantizer 130 and then mapped to converted DCT coefficient 
values F^u,v) by DCT converter 140. DCT converter 600 
operates the same as DCT converter 140 to convert original 
DCT coefficient values to converted DCT coefficient values. 

50 DCT converter 600 also performs additional operations 
described below. Further, DCT converter 600 includes 
memories for storing the pre-computed values PCV, original 
DCT coefficients, and converted DCT coefficients. 
The original DCT coefficient values are provided to DCT 

55 converter 600 to generate the converted macroblock GMB. 
In the examplary embodiment of the invention, a region 
defined by two macroblocks vertically and three macrob- 
locks horizontally of a coded input image having a resolu- 
tion from 1920 by 1024 are used to produce a single 

60 macroblock of 640 by 540 of a coded output image. A 
portion of the input image corresponding to the entire width 
of the picture is stored. This portion of the image includes 
one or more slices. A slice is a consecutive series of 
macroblocks which represent a group of sixteen consecutive 

65 horizontal lines of the image. For example, for a MP@HL 
encoded signal, 240 consecutive macroblocks in one row 
correspond to an entire row of an image. 
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Far example, macroblocks MB0-MB2 and MB3-N1B5 foimat This simplifies the operation of the system In an 
from FIG. 3(a) arc shown in FIG. 10 contained in slices A alternative embodiment, the macroblocks MB0-MB5 in 
and B, respectively. As the converted macroblocks are frame format may be converted to field format and the 
generated, macroblocks MB0-MB2 in slice A are stared in macroblocks MB0-MB5 may be processed as described 
the memory (not shown) of DCT converter 600. Macrob- 5 below in field foimat instead of frame format 
locks MB3-MB5 in slice B are provided to and stored in the The appropriate steps 710, 720, 750, and 740 are par- 
memory and used in combination with macroblocks farmed for each of the original macroblocks MB 0— MBS 
MB0-MB2 which have been retrieved from the memory to used to produce the converted macroblock CMB. For 
generate the converted macroblock CMB shown in FIG. example, original macroblock MBO is in field format and 
3(c). 10 intra coded. Thus, macroblock MBO is processed in step 710 

In addition to generating the converted DCT coefficient and, then, step 730. If the next macroblock MB1 is in field 
values F^<u,v) in the converted macroblock CMB, DCT format and non-intra coded, then macroblock MB1 is pro- 
converter 600 also processes the macroblocks in response to cessed through step 710, step 720, step 730 and step 740. 
the motion parameters of the macroblock. The operation of Each of the other original macroblocks MB2-MB5 is pro- 
the circuitry for processing the macroblocks to generate 15 cessed appropriately depending upon the format and coding 
motion parameters for the converted macroblocks is of each of the original macroblocks MB0-MB5. 
explained in greater detail below with reference to FIG. 8. Next, at step 750, the DCT coefficients in the original 

As shown in FIG. 8, at step 700, the DCT converter 600 macroblocks MB0-MB5 are mapped into converted DCT 

determines whether the macroblock is to be a non-intra or coefficient values F^u.v). The mapping performed at step 

intra coded macroblock. As shown in the example of FIG. 4, 20 750 is the same as the processing explained above with 

six macroblocks MB0-MB5 arc converted to one macrob- regard to FIGS. 2(a) and 2(b). At step 760, a quantized scale 

lock CMB. In other words, the resolution of the picture factor Q_scale is obtained for the converted macroblock 

containing the six macroblocks MB0-MB5 is changed from based on the change in resolution of the image. 

1920 by 640 pixels per frame to 640 by 540 pixels per frame. Returning to FIG. 7, the converted DCT coefficients 

Further, each of the six macroblocks MB0-MB5 can be 25 F^u^v) provided by the DCT converter 600 are quantized by 

either non-intra coded or intra coded. Therefore, it is nee- quantizer 650 using the quantized scale factor Q_scale 

essary to determine whether the converted macroblock is to produced by DOT converter 600. The quantized scale factor 

be non-intra coded or intra coded based on the original six Q__scale determined at step 760, shown in FIG. 8, and the 

macroblocks MB0-MBS. DCT converter 600 employs a coding type of the converted macroblock CMB determined 

majority rule using the original macroblock MB0-MB6 to 30 at step 700, shown in FIG. 8, are provided to fourth 

determine if the converted macroblock is non-intra coded or converter 640. The macroblock header MB is then modified 

intra coded. by fourth converter 640 using the coding type of the con- 

With reference to FIG. 3(a), for example, if four of the verted macroblock and the quantization scale factor 

original macroblocks MBO, MB I, MB2, and MB4 are Q_scale, Finally, the quantized converted DCT coefficients 

non-intra coded and two of the original macroblocks MB3 35 are variable length encoded. 

and MB5 are intra coded, then the converted macroblock is Alternatively, if it is determined at step 700, shown in 
non-intra coded. Alternatively, if four of the original mac- FIG. 8, that the converted macroblocks is to be non-intra 
roblocks MBO, MB1, MB2, and MB5 are intra coded and coded, then, the original macroblocks MB0-MB5 are pro- 
two of the original macroblocks MB3 and MB5 are non- cessed at steps 700, 800, 810, and 820 as shown in FIGS, 
intra coded, then the converted macroblock is intra coded. If 40 9(a) and 9(b). As illustrated in FIG. 9(a), for step 700, all of 
three of the original macroblocks MBO, MB1, and MB4 are the macroblocks 900 are considered, as described above, to 
non-intra coded and three of the original macroblocks MB2, determine if the converted macroblock is intra coded. At step 
MB3 and MB5 are intra coded, the inventor has determined 800 shown in FIG. 8, the non-intra coding type of the 
that the code type of the converted macroblock is non-intra converted macroblock is determined. At step 800, the P-type 
coded. 45 MB is dropped because the majority prediction type is 
Returning to FIG 8, if the converted macroblock CMB is B-type. As shown in FIG. 9(a), only the non-intra coded 
determined to be an intra coded macroblock at step 700, macroblocks 910 are used to determine the coding type. As 
then, at step 710, it is determined which original macrob- described above with regard to step 700, majority rule is 
locks MB0-MB5 are intra coded and which are non-intra used to determine the coding type. In FIG. 9(a), the majority 
coded. Hie original DCT coefficient values in each of the so coding type is B-type, therefore, the converted macroblock 
original macroblocks which are non-intra coded, for CMB is coded B-type. Then, at step 810 shown in FIG. 8 and 
example, macroblocks MB3 and MB5, are averaged to illustrated in FIG. 9(a), only the B-type macroblocks 920 are 
generate an average DCT coefficient value. Then, at step used to determine the motion decision type: field prediction 
720, each of the original DCT coefficient values F^u'y) in or frame prediction. At step 810, one of the B-type blocks is 
the non-intra coded macroblocks are replaced with the 35 dropped because it uses frame based prediction while the 
average DCT coefficient value. For example, a DCT average others use field based prediction. 

value of the original DCT cremcient values F f/ (u\V) in In field prediction, predictions are made independendy for 

macroblock MB3 is produced and each of the original DCT each field using data from one or more previously decoded 

coefficient values F r <{u i y) in macroblock MB3 are replaced fields. Frame prediction forms a prediction for the frame 

with the average DCT value. After step 720, or after step 60 from one or more previously decoded frames. Accordingly, 

710, step 730 is executed. field or frame prediction is selected for the converted 

At step 730, it is determined whether the macroblocks macroblock CMB based on the field and frame format of the 

MB0-MB5 are in field ox frame format. At step 740, the original maaoblocks selected at step 800. Majority rule is 

format of the macroblock MB0-rMB5 is converted to frame used to select the field or frame prediction. As illustrated in 

format if it is determined mat the macroblock MB0-MB5 is 65 FIG. 9(a), field prediction is selected at step 810 because 

in field format The format of the macroblock is converted original macroblocks MBO, MB2, and MB4 are in the 

so that each of the macroblocks is processed in the same majority and coded using field prediction. Finally, at step 
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820, the motion vector for the converted macroblodc is 
selected using the remaining macroblocks 930. As in steps 
800 and 810, shown in FIG. 8, majority rule is used to select 
the motion vector. 

In the event that there is not a majority from which the 
prediction type can be determined, the prediction type is 
selected based on the following order of preference: 
bi-directional prediction, forward prediction, and backward 
prediction. For example, if only two macroblocks are 
remaining from which to select the prediction type, and one 
is bi-directionaly coded and the other is forward coded, then 
the selected prediction type is bi-directional for the con- 
verted macroblodc 

In the event that there is not a majority from which the 
motion type can be determined, the selected motion type is 
frame type for the converted macroblock. In the event that 
there is not a majority from which the motion vector can be 
determined, the first motion vector of the first macroblock 
processed at step 820, shown in FIG. 8, becomes the selected 
motion vector for the converted macroblock: CMB. 

FIG. 9(b) is another data structure diagram illustrating the 
operation of steps 700, 800, 810, and 820 shown in FIG. 8 
in response to different input macroblock MB0-MB5. In 
FIG. 9(b), the majority of macroblocks are non-intra coded. 
The non-intra coded macroblocks MB0-MB4 are used at 
step 800, shown in FIG. 8, to determine the prediction type: 
P-coded. Then, at step 810, shown in FIG. 8 and illustrated 
in FIG. 9(b), only the P-coded maaoblocks MB1, MB2, and 
MB3 are used to determine the motion decision type: frame 
prediction. Finally, at step 820, the motion vector for the 
converted macroblock is selected using the frame prediction 
P-type macroblocks MB1 and MB3. 

Next, at step 830 shown in FIG. 8, for each original 
macroblock MB0-MB5, it is determined if me original 
macroblocks MB0-MB5 have the same prediction type, 
motion type, and motion vector selected for the converted 
macroblock CMB. Each original macroblock MB0-MB5 
which does not have the same prediction type, motion type 
and motion vector has its residual original coefficient values 
set equal to zero at step 860. Otherwise, it is next 40 
determined, at step 840 whether the original macroblock is 
in frame or field format. Then, at step 750, once the 
macroblock has been converted to frame at step 850, or if the 
macroblock is already in frame format, OCT mapping is 
performed at step 750 as described above. 

When the resolution of the image is increased, the number 
of macroblocks is increased. In this case, the same method 
is used to select the intra/non-intra coding, the motion type, 
the prediction type, and the motion vector for the converted 
macroblocks. DCT coefficients for the converted macrob- 
locks are also generated by directly mapping the DCT 
coefficients of the original macroblocks to increase the 
number of DCT coefficients. 

Next, at step 760, a quantization scale Q_scale factor is 
produced by averaging the quantization scale factors of the 
original maaoblocks MB0-^ftB5 which are used to generate 
the converted macroblock CMB. Quantizer 650, shown in 
FIG. 7, applies the qu ant iz at ion scale factor Q_scale factor 
to the converted DCT coefficients to produce quantized DCT 
coefficients values QDCT. 

Next, converter four 640 shown in FIG. 7, generates a 
converted macroblock header for the converted quantized 
coefficients values QDCT. The intra/non-intra macroblock 
type decision from step 700, the prediction type decision 
from step 800, the motion type decision from step 810, and 
the motion vector from step 820, each shown in FIG. 8, are 
provided to converter four 640 from DCT converter 600. 



The Q_scale factor is provided from quantizer 650. As 
described above with reference to Table 9, converter four 
640 uses the intra/non-intra macroblock type decision from 
step 700, the prediction type decision from step 800, the 
motion type decision from step 810, and the motion vector 
from step 820, each shown in FIG. 8, the change in 
resolution, and the quantization scale Q__scale, to produce 
the converted macroblock header. 

As shown in FIG. 7, the sequence header SH, the group 
of picture header GOPH, the picture header PH, the shce 
header SLH, and the macroblock header MBH are combined 
with the variable length encoded signal from VLC 660 at 
combiner 670 to produce an output bit stream OBS. The 
output bit stream is, for example, a MFEG-2 MP@ML 
encoded signal 

Although illustrated and described herein with reference 
to certain specific embodiments, the present invention is 
nevertheless not intended to be limited to the details shown. 
Rather, various modifications may be made in the details 
within the scope and range of equivalents of the claims and 
20 without departing from the spirit of the invention. 
What is claimed is: 

1. An apparatus for transforming the resolution of an 
image from a first resolution to a second resolution where a 
first plurality spatial frequency coefficient (SFQ values 
correspond to the image at the first resolution and a second 
plurality of SFC values correspond to the image at the 
second resolution, the apparatus comprising: 

memory means for storing a plurality of pre-computed 
values where the pre-computcd values determine the 
change in the resolution of the image from the first 
resolution to the second resolution; and 
converter means for directly converting the resolution of 
the image by mapping the first plurality of SFC values 
to the second plurality of SFC values in the spatial 
frequency domain, the converter means including: 

(a) means for confining the pre- computed values with 
the first plurality of SPC values to produce processed 
values; and 

(b) means for combining ones of the processed values 
to produce at least one of the second plurality of SFC 
values. 

2. The apparatus according to claim 1, wherein the 
converter means further comprises: 

means for multiplying one of the plurality of pre- 
computed values by one of the first plurality of SFC 
values; 

means for multiplying another one of the plurality of 
pre-computed values by one of the first plurality of SFC 
values; and 

means for adding the multiplied values together to pro- 
duce one of the second plurality of SPC values. 

3. The apparatus according to claim 1, wherein the 
converter means comprises: 

means for multiplying a first one of the plurality of 
pre-computed values by a first one of the first plurality 
of SFC values to produce a first mtermediate value; 
means for multiplying a second one of the plurality of 
pre-computed values by a second one of the first 
plurality of SFC values to produce a second interme- 
diate value; and 
means for combining the first and second mtermediate 
values to produce one of the second plurality of SFC 
values. 

4. The apparatus according to claim 1, wherein the 
converter means retrieves the pre-computcd values from the 
memory means. 
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5. The apparatus according to claim 1, wherein the first 
plurality of SFC values includes high frequency SFC values 
which correspond to high spatial frequency components in 
the image, and the apparatus further comprises filter means 
for ftKminating the high spatial frequency components of the 
image by removing the high frequency SFC values. 

6. Hie apparatus according to claim 1, wherein the 
pre-computed values represent a combination of conversion 
coefficients in the spatial frequency domain for converting 
the first plurality of SFC values which is equivalent to an 
interpolation of corresponding pixels in the pixel domain. 

7. The apparatus according to claim 1, wherein the first 
plurality of SFC values and the second plurality of SFC 
values are Discrete Cosine Transform (DCT) coefficients. 

8. The apparatus according to claim 7, wherein the first 
plurality of SFC values are arranged in blocks of macrob- 
locks and the second plurality of SFC values are arranged in 
converted blocks of converted macroblocks, and one of the 
plurality of pre-computed values is used to map a zl-th DCT 
coefficient value of a jl-th block of an il-th macroblock to 
a z-th SFC value of a j-th converted block of an i-th 
converted macroblock; where zl, jl, il, z, j, and i are 
integers. 

9. The apparatus according to claim 7, wherein the image 
at the first resolution is represented by an MPEG Main 
Profile, High Level signal which contains the first plurality 
of SFC values and the image at the second resolution is 
represented by an MPEG Main Profile, Main level signal 
which contains the second plurality of SFC values, and the 
converter means is further for converting the MPEG Main 
Profile, High Level signal to the MPEG Main Profile, Main 
level signal. 

10. The apparatus according to claim 7, wherein the image 
at the first resolution is represented by an MPEG Main 
Profile, Main Level signal which contains the first plurality 
of SFC values and the image at the second resolution is 
represented by an MPEG Main Profile, High level signal 
which contains the second plurality of SFC values, and the 
converter means is further for converting the MPEG Main 
Profile, High Level signal to the MPEG Main Profile, Main 
level signal, 

U. A decoder for decoding an MPEG encoded image and 
changing the resolution of the encoded image, the decoder 
comprising: 

variable length decoding means for receiving and decod- 
ing an input signal containing DCT values, the DCT 
values defining a first resolution of the image; 

inverse quantization means for dequantizing the DCT 
values; and 

memory means for storing a plurality of pre-computed 
values where the pre-computed values determine the 
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change in a resolution of the encoded image from the 
first resolution to a second resolution; and 
converter means for directly converting the resolution of 
the encoded image by mapping the DCT coefficient 
values to a plurality of converted coefficient values in 
the spatial frequency domain, the converter means 
including: 

(a) means for combining the pre-computed values with 
the DCT coefficient values to produce processed 
values; and 

(b) means for combining the processed values to pro- 
duce at least one of the plurality of converted coef- 
ficient values. 

12. A method for transforming the resolution of an image 
from a first resolution to a second resolution where a first 
plurality spatial frequency coefficient (SFC) values corre- 
spond to the image at the first resolution and a second 
plurality of SFC values correspond to the image at the 
second resolution, the method comprising the steps of: 

(a) storing a plurality of pre-computed values where the 
pre-computed values determine the change in the reso- 
lution of the image from the first resolution to the 
second resolution; and 

(b) directly converting the resolution of the image by 
mapping the first plurality of SFC values to the second 
plurality of SFC values in the spatial frequency 
domain, step (b) comprising the steps of: 

applying the pre-computed values to the first plurality 
of SFC values to produce processed values; and 

combining ones of the processed values to produce at 
least one of the second plurality of SFC values. 

13. The method according to claim 12, wherein step (b) 
comprises the steps of: 

multiplying a first one of the plurality of pre-computed 
values by a first one of the first plurality of SFC values 
to produce a first intermediate value; 
multiplying a second one of the plurality of pre-computed 
values by a second one of the first plurality of SFC 
values to produce a second intermediate value; and 
combining the first and second intermediate values to 

produce one of the second plurality of SFC values. 
14 The method according to claim 12, wherein the first 
plurality of SFC values and the second plurality of SFC 
values are Discrete Cosine Transform coefficients. 

15. The method according to claim 12, wherein the 
pre-computed values represent a combination of conversion 
coefficients in the spatial frequency domain for converting 
the first plurality of SFC values which is equivalent to an 
interpolation of corresponding pixels in the pixel domain. 
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